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An autonomous and reversible Maxwell's demon 
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Abstract - Building on a model introduced by Mandal and Jarzynski [Proc. Natl. Acad. Sci. 
U. S. A., 109, (2012) 11641], we present a simple version of an autonomous reversible Maxwell's 
demon. By changing the entropy of a tape consisting of a sequence of bits passing through 
the demon, the demon can lift a mass using the coupling to a heat bath. Our model becomes 
reversible by allowing the tape to move in both directions. In this thermodynamically consistent 
model, total entropy production consists of three terms one of which recovers the irreversible 
limit studied by MJ. Our demon allows an interpretation in terms of an enzyme transporting and 
transforming molecules between compartments. Moreover, both genuine equilibrium and a linear 
response regime with corresponding Onsager coefficients are well defined. Efficiency and efficiency 
at maximum power are calculated. In linear response, the latter is shown to be bounded by 1/2 
if the demon operates as a machine and by 1/3 if it is operated as an eraser. 



Maxwell's demon is a device which allows to extract 
work from a heat bath by rectifying fluctuations. It has 
inspired discussions on the foundations of thermodynam- 
ics for more than a century [TJH]- Recently, its inherent 
aspect of information processing in a thermodynamic set- 
ting has turned into focus in theoretical studies of specific 
devices [3UT4]. in the derivation of fluctuation theorems 
and second law like inequalities modified for the presence 
of information I15H22J , and through pioneering experimen- 
tal implementations [23l[24] . Typically, these schemes re- 
quire the action of a macroscopic observer and a feedback 
controller. 

An explicit model for an autonomous demon has re- 
cently been introduced by Mandal and Jarzynski (MJ) 
[14] for which the relation between mechanical work and 
information processing, including the notoriously subtle 
issue of the cost of measurement and/or erasure, becomes 
particular transparent. In the MJ model, a frictionless 
tape composed of bits passes through the demon, which 
is also in contact with a thermal bath and a mechanical 
reservoir represented by a mass that can go up or down. 
During a certain time interval the demon interacts with 
the bit, jumping between its internal states with transition 
rates that depend on the mass. Between two interaction 
time-intervals and ignoring correlations between the bits 
on the tape, a new incoming bit is instantaneously cho- 



sen from the probability distribution corresponding to the 
ratio of O's and l's on the tape. The model reaches a pe- 
riodic steady state, where the outgoing tape is a record of 
how the internal states of the demon are influenced by the 
mass. Remarkably, MJ [14] could show that this model 
fulfills a second law like inequality, with the entropy dif- 
ference between the incoming and outgoing tape bounding 
the work that the demon delivers to lift the mass. Satu- 
rating this equality, however, is arguably not equivalent 
to equilibrium since the MJ model contains a fundamen- 
tal asymmetry because the (frictionless) tape is fed into 
the demon from one direction, with no option of a spon- 
taneous reversal of directions, as it would happen if the 
tape was in contact with a thermal reservoir as well. 

The main purpose of this letter is to introduce a model 
for an autonomous reversible demon whose parameter 
space contains genuine thermodynamic equilibrium. In- 
spired by the MJ model, we reformulate and generalize it 
as a fully continuous-time stochastic process. Each transi- 
tion, in principle, is reversible by allowing the tape to move 
in either direction and not just from left to right as in the 
MJ model. This system reaches a nonequilibrium steady 
state for which the thermodynamic entropy production is 
easily identified using the framework of stochastic thermo- 
dynamics |25j . Total entropy production has then three 
contributions, the first corresponding to the difference be- 
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Fig. 1: The five states model with its transition rates. The full 
lines represent the transitions where the tape moves from left to 
right, whereas the dotted line represent the reverse transitions. 
All rates in the figure should be multiplied by k, which sets the 
times scale of the transitions. The cycles /, II, III, and IV, 
as defined in equation JTJ, are indicated as well. 



tween the entropy change of the tape and mechanical work 
as identified by MJ, the second one arising from the fact 
that the tape can reenter from the right side, and the third 
one due to the friction associated with the motion of the 
tape. 

Genuine equilibrium being part of the phase space of 
our system, we can develop a linear response treatment 
with the corresponding identification of the Onsager co- 
efficients. In our analysis, we will exploit an alternative 
chemical representation of the demon as an enzyme that 
transports and transforms particles from one reservoir to 
another. Another mapping of a demon onto a chemi- 
cal model has been suggested independently recently in 
a somewhat related model [JB] . 

The network of five states and the transition rates be- 
tween them define our model as shown in Fig. [TJ First, we 
consider the case where the tape moves only from left to 
right, which means that only the transitions represented 
by the full lines in Fig. [T]are possible. In the central state 
E the demon is not interacting with a bit from the tape. 
From E the system can either jump to OE or IE, with 
rates kl and k(l — I), respectively, where k sets a time 
scale. These jumps represent a bit coming from the left 
to interact with the demon. Therefore, the parameter I is 
interpreted as the probability of an incoming 0, while 1 — I 
gives the probability of an incoming 1. 

If the system is at OE or IE it either jumps to EO or 
El corresponding to the state of the bit going out to the 
right. The transition between the incoming and the outgo- 
ing bit arises from an interaction between the demon and 
the bit, which may transform the incoming bit and lift (or 
lower) the mass, through an auxiliary process involving 
two auxiliary states Eq and E\. An auxiliary transition 
from Eq to Ei (from Ei to Eq) involves lifting (lowering) 
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Fig. 2: The moving demon picture. First the demon binds to 
a bit with rate kl, it then transforms the into a 1 moving 
to the right with rate k(l — q), and, finally, it detaches from 
the tape with a rate k. Therefore, we have a representation of 
cycle Cii defined in ([TJ. 



the mass by an overall distance h. The transitions be- 
tween these two auxiliary states happen on a time scale 
much faster than 1/k. Hence, they are equilibrated on the 
latter scale leading to a stationary probability q for being 
in Eq and 1 — q for being in E\ , where q = / ( 1 + e-^ ) , with 
/ = mgh/ksT and T is the temperature of the heat bath. 
While the initial state Eb (b — 0, 1) for this auxiliary pro- 
cess is given by the state bE characterizing the incoming 
bit, the final state for this auxiliary process E^ (b' = 0, 1) 
determines the state of the outgoing bit Eb' . The sole pur- 
pose of this auxiliary two-state process is to yield effective 
rates for the main network shown in Fig. 1. We note that 
this scheme corresponds to the limit where the interaction 
time becomes infinite in the MJ model. Moreover, if the 
transition goes from OE (IE) to El (EO) then the mass 
is lifted (lowered) by a height h and a quantity of work 
ksTf (we set in the following fc^T = 1) will be delivered 
to (taken from) the mechanical reservoir. On the other 
hand, if the transition went from OE to EO or from IE to 
El, then there is no mechanical work involved. 

From the states EO and El the system jumps to the 
state E with rate k. In these transitions, the demon let the 
transformed bit leave to the right in the outgoing tape and 
comes back to the central state. Therefore, in a complete 
cycle starting and finishing at the central state E, the 
demon gets a bit from the incoming tape, interacts with 
this bit, possibly changing it, and then sends the final bit 
to the outgoing tape. 

We can also consider the model as a demon walking 
along the tape and changing its bits, see Fig. [2] In this 
case the demon binds to the tape, interact with the bit, 
then unbinds from the tape, and proceeds by repeating 
the same process with the next bit. 

Summarizing, the model has four cycles, which are 

Cj = (E, OE, EO, E), C u = (E, OE, El, E), 

C IU = (E,1E,E1,E), C IV = (E,1E,E0,E). (1) 

In the cycle Cu an incoming is transformed into an out- 
going 1, therefore the demon delivers a quantity of work 
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/ to the mechanical reservoir. On the other hand, in the 
cycle Civ an incoming 1 is transformed into an outgoing 
and the demon receives an energy / from the mechanical 
reservoir. In the other two cycles the incoming bit is not 
changed and no work is exchanged with the mechanical 
reservoir. The average time for the completion of a cycle 
is the same for all cycles and given by 3fc _1 , which follows 
from the fact that the escape rate of all states is equal 
to k. Moreover, the four cycles are the only four possi- 
ble paths that start and finish at E, and the probability 
of going through cycle Cn is 1(1 — q) and through cycle 
Civ is (1 — l)q. Therefore, the rate of work flowing to the 
mechanical reservoir in the stationary state is 

w m = kf(l - q)/3. (2) 

The Shannon entropy of the incoming tape is given by 

H(l) = -llnl-(l-l)\n(l-l). (3) 

This quantity measures how much information the incom- 
ing tape contains. Moreover, it is easy to calculate the 
stationary state probability distribution of the model (see 
equation §8$ below), which gives Peo/Pei = q/(l — Q), 
where Pi denotes the stationary probability distribution 
of state i. Hence, in the stationary state the entropy of 
the outgoing tape is H(q) and the rate of information h 
is given by the entropy difference between the outgoing 
tape and the incoming tape divided by the average time 
to complete a cycle, leading to 

h = kAH/3, (4) 

where AH = H(q) - H(l). 

Remarkably, the rates of mechanical work and informa- 
tion flow follow the inequality 

h - w m = k(AH - W m )/3 = kD(l\\q)/3 > 0, (5) 

where W m = (I — q) ln(q/(l — q)) is the average delivered 
work per cycle and D(l\\q) = l\n(l/q) + (1 — l)\n((l — 
V)/(l — q)) is the Kullback-Leibler distance between the 
distribution of incoming and outgoing bits, which is known 
to be non- negative [57] . The expressions obtained for AH 
and W m are identical to the expressions that are obtained 
in the MJ model [2] in the limit where the interaction 
time interval is large. As a first result, we have thus shown 
that the difference AH — W m is given by D(l\ \q). We note 
that in our model the transitions involving a bit coming 
from the left and the bit leaving to the right are modeled 
as a Poisson process with a finite waiting time, whereas in 
the MJ model these processes are instantaneous. 

Depending on the value of I and q, the inequality ([5]) 
can bound the amount of mechanical work that can be ex- 
tracted by transferring entropy to the tape or the amount 
of entropy reduction in the tape generated by the mechani- 
cal energy received from the falling mass [TJ . Specifically, 
without loss of generality we consider I > 1/2, correspond- 
ing to an excess of on the incoming tape. For q > 1/2 



and I > q we have h > and w m > 0, hence the demon 
is a machine that lifts a mass by transferring entropy to 
the tape. On the other hand, for q > 1/2 and I < q both 
quantities change sign and the demon is an eraser that 
uses the energy from the falling mass to erase information 
(reduce entropy) of the tape. For q < 1/2 and I < 1 — q the 
demon also operates as an eraser, while for q < 1/2 and 
I > 1 — q we have h > and w m < 0, meaning that the 
demon just dissipates energy and does not perform any 
useful operation. 

The above model is a fair description of a frictionlcss 
tape interacting with a Maxwell's demon that can lift a 
mass by exchanging entropy with the tape. However, all 
the reversed transition rates, represented by the dotted 
lines in Fig. [T] are zero and, therefore, entropy produc- 
tion in the sense of stochastic thermodynamics cannot be 
defined [35] • From this perspective, it is then somewhat 
surprising that the fluxes h and w m still fulfill the second 
law like inequality ([5]). In the following, we consider all 
transition rates in Fig. Q]to be non-zero, which means that 
the tape can also move from right to left. Such a model 
has a well defined equilibrium. We would like to compare 
the standard entropy production with the dissipation rate 
in equation (JSJ). Before considering the full model as a 
demon interacting with a moving tape we show that the 
model can also be seen as an enzyme that mediates chem- 
ical reactions between different molecules. 

The chemical model can be described as follows. Two 
reservoirs of particles are separated by a membrane. In 
the left (right) reservoir molecules 0l (Or) and 1l (1r) 
are dissolved in a solvent. These molecules can bind to 
an enzyme E sitting on the membrane that transforms 
a molecule of one reservoir into a molecule of the other 
one. The concentration a of the species on the left [right] 
reservoir are cl [cr] for the substance 0l [Or] and c(l — I) 
[c(l — r)] for the substance 1l [1r]- Moreover, the concen- 
trations are small (c <C 1) so that the chemical potentials 
MOx, j Mix, i MOr and fi± R are related to the concentrations by 
Hi = ln(2cj/c), where the additive constant In 2 is chosen 
for later convenience. 

In the cycle Cr, for example, first a molecule 0l from 
the left reservoir binds to the enzyme, then the enzyme 
transforms it into a Or and, finally, the 0^ molecule is 
released into the right reservoir. In the reversed cycle C/, a 
Or is taken from the right reservoir, transformed into a Oz, 
by the enzyme that is then released into the left reservoir. 
The parameter a, in Fig. [T] determines the rate of those 
transitions that correspond to taking a molecule from the 
right reservoir and releasing another molecule into the left 
reservoir: if a < 1 the left to right transitions are faster 
than the reversed transitions. Furthermore, the enzyme 
E is connected to a mechanical reservoir, so that when it 
transforms a 0l (Or) into a 1r (1l), it delivers a quantity 
/ of mechanical work to this reservoir. With the transition 
rates of Fig. [T]the escape rates of the four external states 
are the same, i.e., the average time the enzyme interacts 
with the molecules is the same for all four molecules. 
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Table 1: The affinities related to the respective transitions. 
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The model has the following six affinities (or thermody- 
namic forces): lna , related to the asymmetry between 
movements from left to right and from right to left, the 
four chemical potentials {Mi}, and — /■ We define the sta- 
tionary flux between states i and j as Jij = PiWij — PjWji, 
where tOq is the transition rate from i to j. Each affinity 
is related to a flux which enters the entropy production 
as s = *}2 m J-mJm, where T m denotes the affinity and J m 
the flux between the pair of states related to the affinity. 
In Table Q] we show the affinities and the transitions they 
are related to. 

Within stochastic thermodynamics, the entropy produc- 
tion can be written as cycle affinities multiplied by fluxes 
summed over the fundamental cycles as introduced in (JTJ 
[25] . In this formulation the entropy production takes the 
form 

IV 6 
S = ^ ] Ja ^ ^ d a J- m 
a— I m—1 

IV 6 

= fc(l - a) In a- 1 + E J <> E d a^m- ( 6 ) 

a=I m=2 

where c?™ is a generalized distance that indicates in how 
many of the transitions pertaining to the cycle a the affin- 
ity m appears (see Table [2]). For later convenience, in the 
second equality we have separated the flux J\ = 1 — a 
related to the affinity lna . 

Using Table [21 the entropy production becomes 

s =k(l — a) In oT x 

+ JoE,El(^0 L - Mlj? _ /) + JlE.Eoi^lL - MOjj + /) 
+ JqE,Eo(^O l - MOjj) + JlE,E\{V>l L - MIr)' (?) 

For each external link a we can separate the current 
through it into two contributions, so that J a = J+ — J~ . 
If the link a connects states i and j (from i to j), then 
we have J+ = P%Wij and J~ = PjWji. Moreover, given 
a link a that connects states bE and Eb' (with b, b' or 
1), calculating the stationary state fundamental fluxes we 
obtain 

J+=k[X++aY+}/[3(l + a)}, 

J- =ka[X-+aY-)/[3(l + a)], (8) 



Table 2: The distances d™ entering equation ([6]), where a rep- 
resents the cycles and m the individual affinities. 
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where 

X+ ee [l + b(l-2l)}[q+b'(l-2q)}, 

Y+ = X- = [q + b(l-2q)}[q + b'(l-2q)}, 

Y~ ee [« + 6(l-2<j)][r + 6'(l-2r)]. (9) 

With these definitions we can rewrite the entropy produc- 
tion in the instructive form 

1 IV 6 

| = (l-a)lna- 1 + — — y ^(X+-a 2 r-) £ d™T m , 

1 ' a=I m=2 

(10) 

which is useful in the following discussion. 

Let us now go back to the picture where the demon 
interacts with the tape. Without loss of generality we 
consider a < 1, which means that on average the tape 
moves from left to right. As a self-consistency condition, 
we have to impose that the ratio of probabilities of the 
outgoing bits to the right is equal the ratio of the incoming 
bits from the right. This leads to the condition 

q/(l-q) = r/(l-r), (11) 

i.e., r — q. This means that the tape refed from the right 
has the same statistics as the outgoing tape to the right. 
With this self-consistency condition and using the defini- 
tion ©, we obtain 

1 6 1 

q , 1-L ; E X « E = ——^(AH -W m ), 

•*(! + ") a ~ 2 3(1 + a) 

(12) 

as one contribution to the entropy production. This con- 
tribution is related to the difference between the statistics 
of the bits of the tape coming in from the left and the 
tape going out to the right. It is precisely the term we got 
in equation ([5]), obtained there for the case where a = 0. 
Moreover, from © we also obtain 

1 . _ 6 1 

v 'a ra—2 x ' 

(13) 

This term is due to the fact that the tape coming in from 
the right and tape going out to the left have different prob- 
ability distributions. In our model, we do not keep corre- 
lations between the bits, considering the simplest approx- 
imation where a tape containing a with probability q is 



p-4 



An autonomous and reversible Maxwell's demon 



refed from the right to the left, where the probability of a 
is L Note that for small a, where transitions from right 
to left become rare, the term (fT3|) is negligible compared 
to (|12p . Combining these terms, the entropy production 
of the tape model is given by 



0.5 p 



(l-a)lna x + 



1 



3(1 + a) 



[AH-W m +a 2 D(q\\l)}, (14) 



where the first term (1 — a) In a -1 is due to friction be- 
tween the demon and the tape. 

We now analyze the efficiency of the demon. First we 
consider the case where q > 1/2 and I > q, so that the 
demon operates as a machine. If we maximize the power 
w rn with respect to q, i.e. the load /, for fixed / and a we 
find that the maximal power w* n is reached at q* given by 
the solution of the transcendental equation 

?* + (l-g*)«*M?7(l -<?*)) = *, (15) 

independent of a. The efficiency at maximum power is 
defined as 

rf(a,0 (16) 

where s* is the entropy production at q* . This efficiency 
depends on a and goes to zero for a — > because the dissi- 
pation term (1 — a) lna -1 dominates the entropy produc- 
tion. For a = 1, the dissipation due to friction is zero, and 
the dissipation due to the refeeding of the tape becomes 
more relevant. More precisely, there is an optimal a* (I), 
where the efficiency ?7max(0 = 7 7*( a *(0)0 i s maximal. In 
Fig. 02 we plot a* (I), which is always close to 1 and be- 
comes closer to 1 as Z tends to 1/2. The efficiency ?7max(0 
increases as we approach I = 1/2, where it becomes 1/2. 

If q > 1/2 and I < q the demon erases information with 
a rate —h = —kAH/(3 + a). If we maximize — h with 
respect to I for fixed q and a, the maximum occurs for 
ft = 1/2. The efficiency at maximum "erasure rate" is 
then 

r,\a,q)=-hy^-h^, (17) 

where is the entropy production for ft = 1/2. Again, 
as shown in Fig. [3J the optimal o^(g) is close to 1 and 
approaches 1 for q — >• 1/2. The efficiency ^^(g) at cft(q) 
also increases as q approaches 1/2, where it becomes 1/3. 

In the final part, we introduce the linear response the- 
ory for this demon, for which we go back to the chemical 
model. In linear response, the stationary fluxes take the 
form J m = Y^n=i LmnJ~ n , where the affinities T are given 
in table [Q and the Onsager coefficients L mn are defined as 

dJ„ 



L, 



(18) 
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Calculating this coefficients we obtain for the matrix L 
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Fig. 3: Upper panel: the efficiency ?7m a x as a function of I, when 
the model operates as a machine. Lower panel: the efficiency 
?7max as a function of q, when the model is an eraser. In both 
cases the optimal ot is shown in the inset. 



Note that this matrix is symmetric, in agreement with the 
Onsager reciprocity relations L mn = L nm . It is obtained 
by considering all four chemical potential as independent 
variables. Using the restriction on the chemical potentials, 
within linear response we have T<i = —J-3 and J-4 = 
In addition, with the self-consistency condition (|llj) we 
obtain T§ = —2J-±. Thus, there are only three indepen- 
dent affinities, which we define as T\ = J-\, T2 = Ti and 
.F3 = T§. Moreover, the associated currents are J\ = J\, 
•h = -h — J3, and J 3 = J 6 . 

The linear response entropy production is given by 
s = En^iEn^i^nVn. Using the three in- 
dependent affinities it can be rewritten as s = 
ELiELi^™^"^»> where the the matrix L mn = 



dJ,„ 



F=0 



is given by 



72 
12 6 
6 3 



(20) 



Note that in order to calculate this matrix the relations 
between the chemical potentials and the self-consistency 
condition have to be implemented before taking the deriva- 
tives. The explicit form of the entropy production is then 

s/k = (lna- 1 ) 2 + (2/3)(J - l/2)[(l - 1/2) - (q - 1/2)] 
-(2/3)(«-l/2)[(/-l/2)-(g-l/2)]. (21) 



p-5 



A. C. Barato U. Seifert 



The second term in the right hand side is given by 
T2J2, and is related to the dissipation term 37^3 [AH + 

a 2 D(q\\l)] in (|14p . whereas the third term is T3J3, which 
corresponds to the mechanical work. 

Using these results we can prove bounds on the effi- 
ciency at maximum power in the linear response regime. 
For q > 1/2 and I > q, where the demon operates as 
a machine, the power for fixed I and a is maximal at 
q* = (I + l/2)/2. Calculating the power and the entropy 
production at q*, wc obtain with the definition (|16|) the 
following efficiency at maximum power 



"* (a '° 2 \3[Ha-i)/(l -1/2)]= 
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< -. 

~ 2 



(22) 



When the demon operates as an eraser, noting that within 
linear response AH = 2[(Z - 1/2) 2 - (q - 1/2) 2 ], wc ob- 
tain that the erasure rate for fixed q and a is maximal at 
U = 1/2. Calculating the linear response theory entropy 
production at we obtain 



vHa>,q) = - ( 1 

3 \ [ln{a l )/(q - 1 



/2)] 



1 



1 

< -. 

" 3 



(23) 



Hence, when the demon operates as a machine the effi- 
ciency at maximum power is bounded by the well known 
Curzon-Ahlborn result 1/2, valid for strongly coupled ma- 
chines |251l28j . However, when the demon operates as an 
eraser the efficiency at maximum erasure rate is bounded 
by 1/3. 

In conclusion, our stochastic fully time-continuous ver- 
sion of a Maxwell's demon contains thermal and mechan- 
ical equilibrium as a possible state. It thus allows to de- 
velop a systematic linear response theory and to identify 
Onsager coefficients. As for ordinary machines, we find 
that efficiency at maximum power is bounded by 1/2. Op- 
erating as an eraser, however, the efficiency at maximum 
erasure rate is bounded by 1/3. These linear response 
results can be extended to the non-linear regime where 
we recover in the irreversible limit the inequality between 
mechanical power and information flow found in |14j . The 
derivation of our results was facilitated by exploiting an 
analogy between this demon and an enzyme transforming 
and transporting molecules between two compartments. 
Exploring whether and how these results can contribute to 
a unified theory of autonomous machines that includes the 
aspect of information processing at finite temperature ex- 
plicitly remains a challenging perspective for future work. 
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